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Abstract 

This paper deals with the task of finding certified lower bounds for the performance of Analog to Digital 
Converters (ADCs). A general ADC is modeled as a causal, discrete-time dynamical system with outputs taking 
values in a finite set. We define the performance of an ADC as the worst-case average intensity of the filtered 
input matching error, defined as the difference between the input and output of the ADC. The passband of the 
shaping filter used to filter the error signal determines the frequency region of interest for minimizing the error. 
The problem of finding a lower bound for the performance of an ADC is formulated as a dynamic game problem 
in which the input signal to the ADC plays against the output of the ADC. Furthermore, the performance measure 
must be optimized in the presence of quantized disturbances (output of the ADC) that can exceed the control 
variable (input of the ADC) in magnitude. We characterize the optimal solution in terms of a Bellman-type 
inequahty. A numerical approach is presented to compute the value function in parallel with the feedback law 
for generating the worst case input signal. The specific structure of the problem is used to prove certain properties 
of the value function that simplifies the iterative computation of a certified solution to the Bellman inequality. 
The solution provides a certified lower bound on the performance of any ADC with respect to the selected 
performance criteria. 

I. INTRODUCTION AND MOTIVATION 

Analog to Digital Converters (ADCs) act as the interface between the analog world and digital 
processors. They are present in almost all digital control and communication systems and modem high- 
speed data conversion and storage systems. Naturally, the design and analysis of ADCs have, for many 
years, attracted the attention and interest of researchers from various disciplines across academia and 
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industry. Despite the progress that has been made in this field, the design of optimal ADCs remains an 
open challenging problem, and the fundamental limitations of their performance are not well understood. 
This paper is concerned with the latter problem. 

A particular class of ADCs primarily used in high resolution applications is the Delta-Sigma Modu- 
lator (DSM). Fig. [T] illustrates the classical first-order DSM [[T|, where Q is a quantizer with uniform 
step size. 



Q 



Fig. 1: Classical First-Order Sigma-Delta Modulator 



An extensive body of research on DSMs has appeared in the signal processing literature. One well 
known approach is based on linearized additive noise models and filter design for noise shaping [Hl- 
iSl. The underlying assumption for validity of the linearized additive noise model is availability of a 
relatively high number of bits. Alternative approaches based on a formalism of the signal transformation 
performed by the quantizer have been exploited for deterministic analysis in [IH-flHl. Some other works 
that do not use linearized additive noise models are reported in [|9ll- [fTn . 

In the control field, [fT2l - [fT4ll find performance bounds and suboptimal policies for linear stochastic 
control problems using Bellman inequalities with quadratic value functions. The problem is relaxed 
and solved using linear matrix inequalities and semidefinite programming. For references on quantized 
control, please see [|T5ll - [fT7]| . 

In [[T8l we provided a characterization of the solution to the optimal ADC design problem and 
presented a generic methodology for numerical computation of sub-optimal solutions along with com- 
putation of a certified upper bound on the performance. The performance of an ADC is evaluated with 
respect to a cost function which is a measure of the intensity of the error signal (the difference between 
the input signal and its quantized version) for the worst case input. The error signal is passed through a 
shaping filter which dictates the frequency region in which the error is to be minimized. Furthermore, 
we showed that the dynamical system within the optimal ADC is a copy of the shaping filter used to 
define the performance criteria. In [18] we also presented an exact analytical solution to the optimal 
ADC for first-order shaping filters, and showed that the classical first-order DSM (Figure [T]) is identical 
to our optimal ADC. This result proved the optimality of the classical first-order DSM with respect to 



the adopted performance measure, and was a step towards understanding the limitations of performance. 

In this paper, we present a framework for finding certified lower bounds for the performance of ADCs 
with shaping filters of arbitrary order. We use the same ADC model and performance measure adopted 
in [fTSll . The objective is to find a lower bound on the infimum of the cost function. The approach 
is to find a feedback law for generating the input of the ADC such that regardless of its output, the 
performance is bounded from below by a certain value. Thus, the input of the ADC is viewed as the 
control, and the problem is posed within a non-linear optimal feedback control/game framework. We 
show that the optimal control law can be characterized in terms of a value function satisfying an analog 
of the Bellman inequality. The value function in the Bellman inequality and the corresponding control 
law can be jointly computed via value iteration. 

Since searching for the value function involves solving a sequence of infinite dimensional optimization 
problems, some approximations are needed for numerical computation. First, a finite-dimensional param- 
eterization of the value function is selected. Second, the state space and the input space are discretized. 
Third, the computations are restricted to a finite subset of the space. The latter step deserves further 
elaboration. If the dynamical system inside the ADC is strictly stable, then a bounded control invariant 
set exists, thus it is possible to do the computations over a bounded region. The challenge arises when 
the filter has poles on the unit circle. In this case, there does not exist a bounded control invariant set, 
since the disturbances can exceed the control variable in magnitude. Under the condition that there is 
at most one pole on the unit circle, we present a theorem that states that the value function is zero 
outside a certain bounded space. Thus, we have an a priori knowledge of an analytic expression for 
the value function beyond a bounded region. As a result, the computations need to be carried out only 
over this bounded region. This is in dramatic contrast with the case of upper bound computations IfTSl , 
something to be discussed in section |lllj 

The organization is as follows. Section |ll] provides a rigorous problem formulation. The main contri- 
butions are presented in Section [111] and |IV} Section [111] describes our methodology for finding certified 
lower bounds for ADCs. Section |W] provides our theoretical results. We provide an example in section 



N\ and section VI concludes the paper. 



Notation and Terminology: 

• Function / : M™ i— > M is called BIBO, if the image of every bounded subset Vt C M™ under /, 
/(f2), is bounded. 



Given a set P, i+{P) is the set of all one-sided sequences x with values in P, i.e. functions 

x:Z+^ P. 



• The oo— norm is defined as: 



max I f j I , for v 



Vl 



and 



||,^|| def \\Mv\\^ 

\\M\\oo = sup— —f^ ■ 



max > I M, 



«j I 



for a matrix M = (Mij) e 



olxm 



• Let X be a set and / : X h-i- M be a function. For every e > 0, 

arg*" sup f{x) =^ < X G X : f{x) > — e + sup f{x) 

II. PROBLEM FORMULATION 
The problem setup in this section is taken from [fTSll . 



(1) 



A. Analog to Digital Converters 

In this paper, a general ADC is viewed as a causal, discrete-time, non-linear system ^, accepting 
arbitrary inputs in the [—1, 1] range, and producing outputs in a fixed finite subset U C M, as shown 
in Fig. |2j We assume that the smallest element in the set U is less than —1 and the largest element is 
greater than 1. 



r[n] e hl,l] 
n G Z+ 



u[n] e U 
n G Z_|_ 



Fig. 2: Analog to Digital Converter as a Dynamical System 



Equivalently, an ADC is defined by a sequence of functions T„ : [—1, 1]"^^ i-t- U according to 

\E' : u[n] = Tn {r[n],r[n — 1], ■ ■ ■ ,r[0]) , n G Z+. 
The class of ADCs defined above is denoted by yu- 



(2) 



B. Asymptotic Weighted Average Intensity (AWAI) of a Signal 

The Asymptotic Weighted Average Intensity r/c^i (w) of a signal w with respect to the transfer function 
G (z) of a strictly causal LTI dynamical system Lq and a non-negative function : M i— )► M.^ is given 
by: 

1 ^ 

Vg,<p (w) = limsup V0 , (3) 

Afi-s>oo iV + i 

n=0 

where the sequence q is the response to input w of the dynamical system: 

^ x[n + 1] = Ax[n] + Bw[n\, x[0] = 0, 

and A, B, C are given matrices of appropriate dimensions. Examples of functions to consider are: 
= \q\ ^rid 0(g) = \qf. 



C. ADC Performance Measure 

The setup that we use to measure the performance of an ADC is illustrated in Fig. |3] The performance 
measure of ^ G 3^t/, denoted by J7g,</) (^) , is the worst-case AWAI of the error signal for all input 
sequences r e £+([—1,1]), that is: 



Jg,4> (^) = sup r/G,0 (r - ^ (r)) 

re£+([-l,l]) 



(5) 



)— ^ 




q[n] 


+ 





Fig. 3: Setup Used for Measuring the Performance of the ADC 



D. ADC Optimization 

Given Lq and 0, we consider G ^Vc/ an optimal ADC if Jg,</. (^o) < Jg,4> (*) for all ^ G 3^c/. 
The corresponding optimal performance measure 7g,0 (?/) is defined as 

(6) 

The objective is to find certified lower bounds for ([6]). 



7G,<^ (f/) = inf Jg,^ m 



III. OUR APPROACH 



We find the lower bound on the performance of any given ADC belonging to the class yu by 
associating the problem with a full-information feedback control problem. The objective is to find a 
feedback law for generating the input of the ADC, r, such that regardless of the output u, the performance 
is bounded from below by a certain value. Thus, in this setup, r is viewed as the control and u is viewed 
as the input of a strictly causal system with output r. The setup is depicted in Fig. |4} where the function 
Kr : I— i- [—1,1] is said to be an admissible controller if there exists 7 G [0, 00) such that every 
triplet of sequences {x,u,r) satisfying 



x[r;, + 1] = 74a;[r;,] + 5r[r?,] — Bu[n\, x[0] = 0, 
r[n] = Kr {x[n]) , 
q[n] = Cx[n], 

also satisfies the dissipation inequality 

N 

inf J^(0(gM) -7) > -00. 



(7) 
(8) 
(9) 

(10) 



n=0 



Note that if ( fTO] ) holds subject to ©-©J then jg,4> iU) > 7. Let 7^ be the minimal upper bound 



of 7, for which an admissible controller exists. Then is said to be an optimal controller if (10) is 
satisfied with 7 = 7o- 



r[n\ 



Kr 



L 



G 



q[n\ 



Fig. 4: Full State-Feedback Control Setup 



A. The Bellman Inequality 

The solution to a well-posed state-feedback optimal control problem can be characterized as the 
solution to the associated Bellman equation [fT9l -[|22 l| . Herein, standard techniques are used to show 



that a controller K,. satisfying ([10]) exists if and only if a solution to an analog of the Bellman equation 



exists. The formulation will be made more precise as follows. Define function a-y : M"*!— M by 

(x) = 7 - (/) (Cx) . (11) 



It can be shown that a controller Kj. in ([8]) guaranteeing ( fTO] ) exists if and only if there exists a 
function V : M™ i— )■ IR+, such that inequality 

V ix) > ix) + inf max V [Ax + Br - Bu) (12) 

' rG[-l,l] udU 



holds for all x E MJ^ (see Theorem [T]). We refer to inequality ([12]) as the Bellman inequality, and to a 



function V satisfying (12) as the value function. 



B. Numerical Solutions to the Bellman Inequality 

In this section, we outline our approach for numerical computation of the value function V and the 



control function Kr. We can simplify the problem of searching for a solution to inequality (12) by 
instead finding a solution V > to the inequality 

V ix) > (x) + min max V (Ax + Br - Bu) , Vx G (13) 

where Tr is a finite subset of [—1, 1]. Since for every function (7 : [— 1, 1] i— )• M, we have 

inf g (r) < ming (r) , (14) 

re[-l,l] reFr 



a solution V of (13) is also a solution of (12). In the remainder of this section we focus on finding a 



solution to ( 13 ). 



A control invariant set of system ([7]), with respect to Tr, is formally defined as a subset X C 
such that: 

Vx e X, 3r e : Ax + Br- Bue X, Vm G U. (15) 

Furthermore, a strong invariant set of system ([V]), with respect to Tr, is defined as a subset X C 
such that: 

Ax + Br-Buel, Vx G X, r G Tr, u e U. (16) 

Ideally we would like to have a bounded invariant set, so that the search for V satisfying the Bellman 
inequality is restricted to a bounded region of the state space. If max|eig(y4)| < 1, then a bounded 



set X satisfying (16) is guaranteed to exist. However, if max|eig(A)| = 1, then there is no bounded 



set X satisfying ([T5]), due to the assumption that the smallest element in the set U is less than —1 and 



the largest element is greater than 1. Hence, the case when max | eig(y4)| = 1 presents the challenge of 



searching for a numerical solution to (13) over an unbounded state space. However, for the case that 



there is only one pole on the unit circle, we will establish in Theorem [2] that the value function is zero 



for all X outside a certain bounded region. Hence, the numerical search for V satisfying (13) needs to 
be carried out only over a bounded subset of the state space. Next, uniform grids are created for the 
state space. In this paper, these are uniformly-spaced, discrete subsets of the Euclidean space, and are 
defined as follows. The set 

G = {zA I z G Z} 

is a grid on M, where £) = 1/ A is a positive integer. The corresponding grid on X is 

r = G™ n X. 

Furthermore, we define = {ri, r2, ■ ■ ■ , ri,} as 

F^ = Gn [-1,1] . 

The next step is to create a finite-dimensional parameterization of V. In this paper, the search is 
performed over the class of piecewise constant (PWC) functions assuming a constant value over a tile. 
A tile in G", n G N is defined as the smallest hypercube formed by 2" points on the grid, and thus, has 
2n faces (the faces are hypercubes of dimension n — 1). By convention, we assume that the n faces that 
contain the lexicographically smallest vertex are closed, and the rest are open. The union of all such 
tiles covers and their intersection is empty. Let Tj denote the i*^ tile over the grid G™, and T the 
set of all tiles that lie within X, and Nt the number of all such tiles: 

T = {Ti\ie{l,2,--- ,Nt}}. 
The PWC parameterization of V is as follows 

V{x) = V.,, VxgT„ I e [1,2,- ■■ ,Nt} (17) 



where Vi G M+. We then search for a solution V : X IR+ of (13) for all x G X within the class of 



PWC functions defined in (17). The corresponding PWC control function : X '\^?> given by 



i^'r (x) = argmin max V [Ax + Br — Bu) , Vx G X. (18) 
where T(x) = Tj for x G Tj. In the next subsection we show how to search and certify functions V 



and Kr satisfying (13) and (18). 



C. Searching for Numerical Solutions 



The Bellman inequality (13) is solved via value iteration. The algorithm is initialized at Aq (x) = 0, 



for all X E T, and at stage A; + 1 it computes a PWC function A^+i : T i— > M+ satisfying 



Afc+i (x) = max < 0, (x) + min max Az, (Ax + Br — Bu) > . (19) 

' ' rer^ u(^U,x£T(x) ' 



At each stage of the iteration, Ak+i is computed and certified to satisfy ( [191 ) for sXX x eT as follows: 
1) For every z e {1, 2, ■ ■ ■ , Nt} and j G {1, 2, ■ ■ ■ , L}, define 



(Tj = sup cr^ (a; j 



Yij = {Ax + Brj — Bu \ x E Ti, rj ETr, u E U} , 



and find all the tiles that intersect with Yij 



2) Let 



Compute 



Q^J = {p I TpHF,, ^{0}, p E {1,2,- ■■ ,Nt}}. 



Afc(x), xETs, s G {1,2,-- - ,iVT}. 



Vij = max . 



3) For every tile x E Ti compute PWC functions: 

Afc+i (x) = max <| 0, cXj + minVj^ 



When the iteration converges, it converges pointwise to a limit A : T ^ M_,_, where the limit satisfies, 
for all X E T, the equality 



A (x) = max < 0, cr^ (x) + min max A (Ax + Br — Bu) > . (20) 

' reTr u£U,xeT{x) ' 



The largest 7 for which (19) converges is found through line search. We take V (x) = A (x) , for all 



X E T. The associated suboptimal control law is a PWC function defined over all tiles Tj in the control 



invariant set X that satisfies (18) 



IV. Theoretical Statements 



In this section, we show that under some technical assumptions, the value function in (12) is zero 



beyond a bounded region. However, we first present a theorem that establishes the link between the full 



information feedback control problem and the Bellman inequality ( 12). Note that in this section we use 
subscript notation for values of sequences at specific time instances instead of the bracket notion used 
elsewhere in the paper, that is x„ is used in place of x[n]. 

Theorem 1: Let X be a metric space, f2 C M be a compact metric space, f/ C M be a finite set, 
and f : X X X U i— t-X and cr : X i-t- M be continuous functions. Then the following statements are 
equivalent: 



Voo{x) = sup Vr{x) < oo, Wxe X, (21) 



(i) 



where Vr : X IR+ is defined by 

T-l 

V^(x) = maxminmax ■ ■ ■ min max y hn+i(T{xn), (22) 
with r„, Un, On restricted by r„ G fi, Un & U, 6'„ G {0, 1} and Xn, hn defined by 

Xn+l = f{Xn,rn,Un), Xq =X, Vn G Z+ (23) 

hn+1 = dnhn, ho = 1, Vn G Z+. (24) 

(ii) The sequence of functions : X i— )• IR+ defined by 

Ao (x) = 

Afe+i (x) = max < 0, a (x) + minmaxAfc {f{x,r,u)) > (25) 

converges pointwise to a limit Aqo : X i— )• ]R_|_. 

(iii) There exists a function V : X t-^ IR+ such that 

V"(x) = max < 0, a{x) + mmmaxV{f{x,r,u)) > (26) 

I ref! u£U J 

for every a; G X. 

(iv) There exists a function 1/ : X i— )■ M+ such that 



V{x) > (r{x) + minmax V{f{x, r, u)), Wx G X. 



(27) 



Moreover, if conditions (i)— (iv) hold, then Voo is a solution of ([26]) and 

V^o = Aoo > ^fe = Ak, yk G Z+ (28) 
V>V^. (29) 



for V satisfying (iii). Furthermore, for every x„ satisfying ( [23] ) 

T-l 



sup cr(x„) < OO. (30) 



n=0 



Proof: Please see the Appendix. ■ 
Definition 1: For v E W^\{0}, a cylinder with axis v is a set of the form: 

CqA^) = |p G M"^ : inf (p - tvfQip - tv) < (3] (31) 
where Q G M™^*", Q = Q' > 0, and f3 > 0. 

Remark 1: A cylinder that is an invariant set for system ^ is called an invariant cylinder 

The following theorem establishes that the value function is zero for all x outside a certain bounded 
region. 

Theorem 2: Let f/ C M be a fixed finite set. Consider the system defined by equation (|7]), where 
X G i+iM.""), r G £+([-1,1]), u G i+{U), and the pair {A, B) is controllable. Suppose that A has 
exactly one eigenvalue on the unit circle. Let ei denote the eigenvector corresponding to the eigenvalue 
of A that is on the unit circle. Let /3 > and Q G M™""", Q = Q' > he such that Cq^i^^ci) is an 
invariant cylinder for system (|7]). Let V be defined by ( [2T] ) and cr be BIBO. If the set 



So = {xE CQ,^(ei) : (t(x) > -cq} (32) 
is bounded for some cq > 0, then the set 

M = {xe CQ,/3(ei) : V{x) ^ 0} (33) 

is also bounded. 

Proof: Please see the Appendix. ■ 



V. NUMERICAL EXAMPLE 



Consider the example in [18], were the dynamical system Lq @ has transfer function 

z + 1 



Let U = {-1.5,0,1.5}, (j){x) 
given by 



H{z) 
= \Cx\, and x 

1= {xeR^ 



z{z-iy 



Xi X2 



From [fT8l , the strong invariant set X is 



\xi — X2I < 2.5}. 



(34) 



Due to the pole at 2 = 1, the strong invariant set X given by ( |34| ) is unbounded and defines an infinite 
strip in M^. However, according to Theorem|2]we need to search for V{x) only inside a bounded region 
within this infinite strip, since V{x) = for all x outside a certain bounded region. The bounded region 
is found via trial and error. We select a grid spacing of A = 1/64. Following the procedures outlined 



in subsections IH-B and IH-C the largest 7 for which the iteration in (19) converges to the limit A in 



(20), is 7 = 0.925, which is a certified lower bound on the performance of any arbitrary ADC with 
respect to the specific performance measure selected. Figures [5} 6a, and 6b show the value function V, 



the cross section of V, and the zero level set of V, respectively. Figures |7a| and |7b] show the control 
function and its cross section, respectively. The certified upper bound for the performance of the ADC 
designed in fTSl with respect to the same performance criteria is 1.1875. 




Fig. 5: Value Function V{x) for Lower Bound 




Fig. 6: Value Function V{x) 




VI. CONCLUSION 

In this paper, we studied performance limitations of Analog to Digital Converters (ADCs). The 
performance of an ADC was defined in terms of a measure that represents the worst case average 
intensity of the filtered input matching error. The passband of the shaping filter defines the frequency 
region in which the error is to be minimized. The problem of finding a lower bound for the performance 
of an ADC was associated with a full information feedback optimal control problem and formulated 
as a dynamic game in which the input of the ADC (control variable) played against the output of the 
ADC (quantized disturbance). Since the disturbances can exceed the control variable in magnitude, if 



the shaping filter has a pole on the unit circle, then there does not exist a bounded control invariant 
set, which presents a challenge for numerical computations. This challenge is overcome with theoretical 
results that show that the value function is zero beyond a bounded region, thus computations need to 
be done only over this bounded region. A numerical algorithm was presented that provided certified 
solutions to the underlying Bellman inequality in parallel with the control law; hence, certified lower 
bounds on the performance of arbitrary ADCs with respect to the adopted performance criteria. 

VII. APPENDIX 



Observation 1: The sequence of functions A^ : X k-)- defined by ( [25] ) is monotonically increasing. 

Proof: The proof is done by induction. Since Ao(a;) = for all a; G X, it follows that 

Ai(a;) = max{0, a{x)} > Ao(x), Vx G X. (35) 



Assume, Ak{x) > Ak-i{x) for all x G X. This assumption in conjunction with equation ([25]), results in 
the following inequahty 



Therefore, 



Afc+i (x) > max < 0, 0" (x) + minmaxAfc_i {f{x,r,u)) 
= Afc(x). 



Ao(a;) < Ai(x) < ■ ■ ■ < Afc(x), Vx G X, k e 



Proof of Theorem [T]: (i) =^ (ii) For r = 0, equation ([22]) simplifies to: 



Vo{xo) = 0, Vxo G X. (36) 

For r = 1, we have: 

Vi{xo) = max{0,cr(xo)}. 
The rest of the proof is done by induction over r. For r = 2, we have: 

^2(a;o) = max{0,(j(xo) + minmax6'i(j(xi)} 

= max{0, a{xo) + minmax V^i(/(xo, tq, Mq))}- 

Assume that, 

Vk{xo) = max{0,a(xo) + minmax Vfc_i(/(xo, ro, mq))}. 



Define = 6nhn, /ii = 1, for n = 1, 2, 3 ■ ■ ■ . Equation ( [221 ) can be equivalently written for 

T = k + 1 d& follows: 

k 



\4+i(xo) = max 

do 



do ( ^"(^^o) + min max max ■ ■ ■ min max N hn+i(j{xn) 

ro uo 01 Tk-i Uh-ifik 

n=l 



Therefore, 



Vk+i{xQ) = max{0,cr(xo) + minmax Vfc(/(xo, tq, Mq))}. 



(37) 



From Observation [T] we know that the sequence of functions Vk is monotonically increasing. Since 
a monotonic sequence of functions converge if and only if it is bounded, we have convergence of the 
sequence. 

(ii) =^ (i) Again from Observation [T] the sequence of functions Vk is monotonically increasing; thus, 
in conjunction with convergence of the sequence, we have Aqo < oo. Furthermore, since Afc(x) > for 



all k G Z+, we also have Aoo(a;) > 0. It only remains to show that equation ( [25] ) is equivalent to ( [221 ). 



Equation (25) for A; = 1 is trivially equivalent to: 



^1(3^0) = max 9ncr(xo), Vxn G X 
eoe{o,i} 



For k = 2, equation (25) is equivalent to: 



^2(2:0) = max < 0, ao(xo) + minmaxAi(xi' 

ro MO 



max 



9o I o"o(xo) + minmax{^ia(a;i)} 

ro uofii 



maxminmax > hn+icr(xn)- 

fir. rn fl, ^ ^ ' 



ro Mo,&i 



n.=0 



Assume, 



fc-i 



Afc(a;o) = maxminmax ■■■ min max > hn+i(j{xn}- 

6*0 ro uo,ei rfc_2 Uk-2,9k-i 

n=0 



Substituting the above equation into (25) we have: 



Afc+i(xo) = max 



ft 

6'o ( O"(xo) + minmaxmax ■ • • min max N hn+i<j{xn 

V '■O "0 6»i rfe_i ■^—f 

n=l 



Afc(a;i) 



which is equivalent to ([22]). Finally, since the sequence of functions A^ is monotonically increasing, the 
limit as A; — 00 of Afc is equivalent to its supremum over k. 



(i) =^ (iii) Substituting ([37]) into ( [2T] ) and interchanging the order of the supremum over r with the 
maximum, we get 

Voo{x) = max{0, (j(a;o) + sup minmaxK_i(/(a;o,To,'Uo))}- 

As discussed in the proof of (ii) =^ (i), the supremum over r, in the expression above, is equal to 
the limit as r — )■ oo. Moreover, a well-known theorem from Analysis states that: given a metric space 
X, a compact metric space and a continuous function g : X x M., the function g : X M. 
defined by 

g{x) = ma.xg{x,r), or g (x) = min g{x,r) 

is continuous. Furthermore, given a compact metric space ^l, and a monotonically increasing sequence 
of continuous functions g^ : t-^ M. such that limfc^oo is finite for every r G fi, the following 
equality holds: 

lim min gk{r) = min lim gk{r) 



Therefore, we have (26). 



(iii) =^ (iv) Trivially true. 

(iv) =^ (i) Since ^(x) > for all x, we can rewrite ( [27] ) as 

> max < 0, (t(x) + minmax V^(/(x, r, m)) L (38) 

L r u J 

Inequality ([38]) holds for all x E X, thus it holds for the sequence {xo,Xi, ■ ■ ■ ,Xk-i}, where x^^i 



satisfies ( [23] ). Now take inequality ([38]) with x replaced by xq and substitute for V{f{xo,ro,uo)) the 
corresponding inequality for V{xi): 



^(2^0) > max < 0, (t{xo) + min max max 

ro MO 



Equivalently, 



^^(^^o) ^ max^o I c"(xo) + minmax6'i 

6*0 V ''0 "0,01 



0, + minmax ri, Ml)) 

ri til 



(t(xi) + minmax V(/(xi,ri,Mi)) 

ri Ml 



Repeating this process, we have: 



S(xo) 



^(2^0) > max min max • • • min max 

do ro uo,9i rfe_2 Uk-2,9k-i 

After rearranging terms we have: 



k-l 



y~] /i„+icr(x„) +min max r^.i, Mfe_i)) 

^ — ' rfc_i Mfc_i 



n=0 



>S'(xo) < V{xq) — maxminmax ■ ■ ■ minmax /i„V"(xfc). 

So r-o "0,^1 rk-i Mfc_i 



Non-negativity and existence of V guarantees: 



(39) 



Since (39) holds for all k, we have (21 ). 



The proof for (|28])-([30|) is as follows: Substituting ( [21] ) into the right hand side of ( [261 ) ^i^d using the 
reasoning in (i) =^ (iii) it is easy to see that ( [2T] ) is a solution of ([26]). Furthermore, ( [28] ) was proved 
within the proof of (i) =^ (ii). Inequality ( [29] ) states that ( [2T] ) is the minimal solution of ([26]), this is 
proven by induction. Let F be a function that maps function ^ on X into function FV on X, defined 
according to: 



{FV){x) = max < 0, (t{x) + minmax V{f{x, r, u)) 

then V = FV. Since \^ > 0, we have V >Vo. Assume V > V^, and apply mapping F to both sides 
to get 

FV > FVk = 14+1. 



Therefore, V > Vk for all k, and thus ( [21] ) is the minimal solution of ([26]). Finally, ( [30[ ) is obtained 



by substituting into ( [21] ) the argument of minimums and maximums for the sequences r, u, and 9 
respectively. 



The proof of Theorem [2] relies on Lemmas [T] and [2] below. 

Lemma 1: Let (v4, 5) be a controllable pair. Then, for every bounded set S C M™, there exists a 
finite set X C and a function p : S i-)- [— 1, 1]™, such that x^ ^ X whenever xq E E for every 
solution (x,r) of 



Xn+l = AXn + -B^'n — BUn, U < 171 
Tn = p{Xo)n, U < ITL 

for every u E i+{U), where p(xo)n denotes the n-th element of p{xo). 
Proof: The solution to ([40]) is given by 



(40) 
(41) 



Xr 



m— 1 m—1 
1=0 1=0 



(42) 



Since S is bounded, A™S is also bounded, thus the first term on the right hand side of (|42]) is 
bounded. Let denote the controllability matrix: 

= [A^'-^B-'-AB B]. 

Construct a finite set H^? C S as follows: let Ep he the intersection of S and the set consisting of 
uniformly spaced Cartesian grid points with spacing A, where 

a<2/||l;'||oo. 

Then for every yo G S, there exists ^ G such that: 

Ibo-elloo < A/2 



Thus, 



which implies 



\L:\yo-i)\\oc<l, 



Then for 



we have 



L,-^(A"^xo-e)e[-l,l]'", Va;oGS (43) 



p{xo) = -L-\A^Xo-0, (44) 



m— 1 

i=0 



Since Ep and U are finite sets, takes only a finite number of values. 



Lemma 2: Assume {A, B) is controllable and the function cr : ^-^ M is BIBO. If in ([2T])-(|22l) 
satisfies 

Voo{x) < oo, Vx G (45) 

then Voo is BIBO. 

Proo/- Let a : X £+([-1, 1]) X £+(f/) x Z+ be a function that maps the initial state 

Xq and sequences r and ?i to the state x at time k, where the evolution of the state is given by 

x[n + 1] = + i?r[n] — Bu[n\: 

a{xo,r,u, k) = Xk- (46) 
Equation ( |22l ) can be equivalently written as: 



{m— 1 T— 1 

y hn+i(T{xn) +maxmin max ■■■min max > hn+i(y{xn] 
n=0 n=m 

(47) 

Denote, 



We can rewrite ( [47] ) as: 

' m—l 



Vt{xo) = max min max - • • min max < > /i„+i(t(x„) + Vr{a{xQ,r,u,m)) > (48) 

6*0 ro Uofil rm-1 Mm-l ■^^ — ^ 

k n=0 >» 

Let H be a bounded subset of M™ and xq E E. Furthermore, let p : S i— )■ [— 1, 1]™ be the function 



defined in (44) and X C denote the set of all states that can be reached in exactly m steps for some 
input sequence u E i+iU). According to Lemma [l| the set X is finite. Let r = p(xo), consequently 

a{xo, p{xo)^u,m) = Xm ^ X for every sequence u. Denote f = {rjj^Q^, u = {ui}^^, and 

m— 1 

' ^+la{Xr^ 



V (^xo,r,u,6^ = ^ hn 

n=0 

Let f = {p(a;o)i}™o^ ^'^^ denote. 



Thus, 



where G X for every sequence u. Taking supremum over r from both sides of the above inequality, 
we have: 

Voo{xo) < sup max \ v {xq,u,0\ + V^ix^^ \ , 
= max|z/ (xo,u,9^ + Voc{xm)^ . 

Hence, 

sup V"oo(a;o) < sup maxi/ (xo,u,6'] + sup max Voo(xm)- (49) 
Since H and U are bounded, the set 

n-2 

^ v4*^+^E(r„_fc - ■.xEE,rkE [-1,1], Uk E U 

k=-l 



is also bounded for every finite n. Furthermore, a is BIBO, which immediately implies that the first 



supremum on the right side of inequality (49) is bounded. Moreover, Xm can take only a finite number 



of values for every xq G H and every sequence u. Since Voo is finite and the supremum over a finite set 



is finite, the second term on the right side of inequality (49) is also bounded. Hence is BIBO. 



Proof of Theorem |2| For system (|7]) with exactly one pole zi on the unit circle and all other poles 
strictly inside the unit circle, with ei G ]R'"\{0} such that Aei = ziCi, and Q G M™^"*, Q = Q' > 
such that Q > A'QA, there exists an invariant cylinder with axis ei for some (3 > 0. Furthermore, the 
intersection of Cq^p^ei) with the set {|eix| < ( : x E M™, C > 0} is bounded whenever Cei ^ 0. Define 

Mq = sup Voo{x). 

x&So 

Lemma [2] guarantees finiteness of the supremum. Let a : x ^+([—1, 1]) x £+(f/) x Z_|_ 1— )■ be a 
function defined in the proof of Lemma |2] Let L denote the smallest integer strictly larger than Mo/eo. 
Define 

Sl = {x e Cg^pie,) : a{x,r,u,k) ^ So, < L, Vr G ^([-1, 1]), W e h{U)} 

That is, Sl is the set of all states within the invariant cylinder from which Sq cannot be reached in L 
steps or less. The complement of the set Sl is the region of the cylinder for which there exist sequences 
r and u such that the state gets to Sq in L steps or less. Since, both r and u are uniformly bounded, 
the set Sl is bounded. 

For J = {0, 1, 2, ■ ■ ■ , r - 2}, define functions gj : W x ^+({0, 1}) x 1]) x £+([/) ^ M, 

r-l 

{6'i}^^Q, {ri}]Zo, {wij^^o) = min max ■ ■ -min max /i„+icr(x„) (50) 

Tj Ujfij^i rr-2 Mt-2,^'t-1 

n=0 

T-1 

gr-i{x, {9^}J-^, {ri}JI^, {uiYi-^) = ^ hn+icr{xn) (51) 

n=0 

For e > and x G R"", let r(x) G Z+, Qo{x) G {0, 1}, ^o(^) G [-1, 1], Uo{x) G U, Qi{x) G {0, 1} 
be functions such that: 

r(x) G arg" sup (52) 
Qo{x) = 6*0 G argmax5(o(^, 6^0), (53) 

Sq 

Ro{x) =ro G argminmax^ii (x, (6o(x),6'i) ,ro,Mo) , (54) 

ro uo,9i \ \ J / 

Wo(^),0i(^)) = G argmaxfiii {Qo{x),Q^ ,Ro{x),Uo^ . (55) 



For X G and j = {0,1, 2,-- - ,t{x) - 2}, let 6 G {0, R g U G 

-Rj(a;) G [—1, 1], G U, and 6j+i(a;) G {0, 1} be functions such that: 

= ({e.(x)}to,^,+i) , R = ({^.(a^)}£o\^.) , ^ = {{U,{x)yr^lu^ . (56) 

= Tj G argmin max ^f^+i ( x, 9, i?, f/l , (57) 
(Wj(x),ej+i(^)) = {uj.Oj+i) G arg max 5(^+1 ix ,Q , {R^{x)}1^qM) . (58) 



Assuming that x E Sl, there are two cases to consider, either: 

1) {R,{x)}il^, {U^{x)}iIl J) i So, for all J G {0, 1, 2, ■ ■ ■ ? - 1}. 



2) There exists an integer J > L such that a{x, {-Ri(a;)}/^o^, {Wi(a;)}/^o^, J) G S'( 



From equations (50)— (58), we have: 



goix,0) = 0, (59) 



go{x, 1) = min hn+icr{xn) (60) 

\'^ti=o n=0 



where {ui}lil>-' = {U,{x)}ZT and {e.}[rr = {e,(x)}[rr • Furthermore, by ([21]) and ([52]), we 
have: 

V;o(^) < e + Vr{s;){x) =€ + maxgo{x, Oq) (62) 

= e + max{5(o(x,0),5(o(x, 1)} . (63) 

Consider case (1): since a{x) < —eq for all x ^ Sq, the sum over /i„+icr(x„) will be negative for all 
r(x). Thus, 

< e, Vx G Sl. (64) 
For case (2), we can write gQ{x, 1) equivalently as: 

{J-l 
^ /i„+i(j(x„) + min max ■■■ min max > 
n=0 n=J 

(65) 



Since the first summation term in ( |65| ) is bounded above by — Jcq for {0j(x)}/jQ and all sequences 
{ri}'-^Q and {ui}'-~Q, and the second summation term is equal to go{a{x, {rj}/ro^, {ui}^~^, J), 9j), we 
have: 

5(o(x, 1) < minmax- ■ -min max {-Jeo + goioi{x,{ri}f~^,{ui}f^Q,J),9j)}. (66) 

ro uo,ei rj_2 Mj_2,6»,j_i 

Since 

^/o(a(x, {Mx)}f=o\ m^)}f=o\ J)^ ^A^)) < Mo, (67) 

we have: 

go{x, 1) < Mo - Jeo- (68) 

Furthermore, J > Mo/eo, thus, 

V;o(x) < e + max {0, Mq - Jeo} = e. (69) 
Since, V^o (x) < e for every e > 0, 

VUx) = 0, WxeSl. (70) 



Finally, the complement of the set Sl is bounded; therefore, (33) is bounded. 
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